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ABSTRACT 



Despite their progress, most schools in Kansas' Quality 
Performance Accreditation (QPA) System fall short of the philosophy and 
practice envisioned by QPA. What has been accomplished and what remains to be 
done in QPA is detailed in this two-volume report. It was found that teachers 
working together were at the center of improvement. Schools where teachers 
recognized a problem existed but saw no way to fix it usually did not show 
improvement in academic performance. Many teachers' horizons were 
circumscribed; some of the solutions put into place were neither 
research-based nor particularly effective. Two elements were required for 
improvement: recognizing problems and believing them to be "fixable." Schools 
offering solutions found that they gained in teacher strength and pride. 

Taken as a whole, the QPA pilot schools perform on a par with all other 
schools in Kansas, although about a fifth of the 135 QPA pilot schools 
recorded strong, measurable improvement in student academic performance. The 
most identified components of success were the QPA pressures to identify, 
collect, and analyze object data on performance and then assess the data and 
implement solutions. The second volume of the report features technical 
appendices consisting of data sources, technical issues, and the data 
collection instruments. (RJM) 
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Summary 



In those Kansas QPA pilot schools where student academic performance has been 
rising since 1992, stakeholders (particularly teachers but including parents and 
community members) talk more about change and experiment more with new practices 
than in schools where academic performance is holding steady or declining. Schools that 
are improving are finding that increased, better-focused professional development 
supports change, as do specific instructional practices and assessment rubrics such as the 
six-trait writing model. However, despite their progress, most of these schools have not 
yet fully reached the philosophy and practice of schooling envisioned by the QPA 
process. 

Teachers, working collaboratively, were at the center of improvement. In improving 
schools, teaching staff realized that specific problems existed and that they, the teachers, 
had the capacity, skill, and support to attack the problems successfully. Some schools 
were led to this realization by a superintendent or principal; at other schools, a teacher or 
group of teachers reached it independently. For some schools, the process began when 
becoming a QPA pilot school required them to collect data and look at their performance; 
for others, the QPA process built on work begun previously. 

Schools where teachers recognized a problem existed but saw no way to fix it 
usually did not show improvement in academic performance. Both elements, recognizing 
a problem and believing it to be “fixable,” were required. QPA provided the opportunity 
to see and to find new support for fixing things. 

Many improving schools found they gained in teacher strength and pride. Staff in 
the improving schools frequently reported that they possessed solid skills and important 
answers, and that they were neither helpless nor dependent upon outside experts or 
processes. Some evidence suggests that smaller, more isolated schools might have a leg- 
up in the process towards improvement: They appear to have little choice but to rely on 
themselves. 

On the other hand, much work remains. Many teachers’ horizons are circumscribed: 
They do not stand tall enough and do not see far enough. Some of the solutions pilot 
schools have put into place are neither research-based nor particularly effective. Many 
teachers complain of needless QPA paperwork; some deny external evidence of their own 
effectiveness; some resent state interference (while requesting support). 

Taken all together and looking back over time, the QPA pilot schools perform on a 
par with all other schools in Kansas: As a group, their performance on the Kansas 
Assessment annually is not distinguishable from other Kansas schools. (But then, all 
Kansas schools are now part of QPA.) On the other hand, about a fifth of the 135 QPA 
pilot schools recorded strong, measurable improvement in student academic performance 
since 1992. 
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Almost without exception, staff at these improving schools identified consequences 
of their participation in the QPA pilot process to be among the critical elements enabling 
the drive toward school improvement. That some of the QPA pilot schools seized the 
opportunities provided by QPA to pull themselves up, often by little more than their boot 
straps, attests to the strength of the teaching staff and to the promise of QPA. 

Staff at the improving schools over and over again pointed to two factors in their 
success, both a part of the QPA process. The first was the QPA pressure to identify, 
collect, and analyze objective data on school, teacher, and student performance. The 
second was that analysis and interpretation of the data and the implementation of 
solutions should be a collaborative activity, led by staff and often shared with the 
community. 

It may be best to let three of these teachers speak: 

It was the QPA teams from each school that made the difference, because we 
saw the data; we realized what needed to be done to improve, and where we 
needed it to be done. 

We spent countless hours [deciding] what we really wanted our children to 
achieve and master. Maybe now we know where we are to focus, what we are 
to do. We have more purpose, more goals. 

You need objectives to know what you’re going to teach and what’s important to 
the community. The thing QPA does is, it makes you pay attention. 
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A Report on Results Achieved 
by Schools That Piloted the Kansas 
Quality Performance Accreditation System 



Introduction 

In August 1997, NCREL began a longitudinal analysis of student academic 
performance and contributing factors in the 135 pilot schools that participated in 
developing the Kansas Quality Performance Accreditation (QPA) System. This analysis 
spanned the school years 1991-92 through 1996-97. Two questions guided the study: 

♦ What do longitudinal data show about changes in student academic 
performance in the QPA pilot schools? 

♦ What key factors contributed materially to change in pupil academic 
performance in the QPA pilot schools? 

NCREL brought to this work a set of core understandings about schools. These 
include: 

♦ Teaching and learning is the heart of any school’s enterprise; all other tasks 
must support teaching and learning. 

♦ Student and teacher engagement in learning must be constant, deep, and of 
high quality. 

♦ The key measure of a school’s productivity is the quality of learning. 

♦ Quality teaching is open, collaborative, and communal. 

♦ Effective, productive schools are communities of learners. 

♦ School improvement is a local phenomenon; family and community 
involvement enhance that process. 

Many factors influence students’ performance in school. Central is what teacher and 
pupil do together, what they enable each other to accomplish. The rest of schooling must 
build on this core, and policy that seeks to improve schooling must be designed to 
support it. Any analysis of the factors that lead to change in schools must address 
activities that occur in classrooms. 

Numerous studies of school performance have focused on factors that exist outside 
the school walls, such as poverty, race, and parental education — factors over which 
school practitioners have little control (Coleman, 1966; Hanushek, 1997; Monk, Hussain, 
Brent, & Roellke, 1997). But research also shows that such external factors account for 
little of the differences in performance among students within schools (Bryk, Lee, & 
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Holland, 1993; Odden 1991). In other words, in-school factors that classroom teachers, 
building principals, and boards of education can influence and control have the potential 
to make a difference in how well students perform (Barr & Dreeben, 1983; Lee, 
Croninger, & Smith, 1997; Newman & Wehlage, 1995; Smylie, Lazarus, & Browlee- 
Conyers 1996). 

The task, then, for school practitioners, and the communities in which they work, is 
to identify the productive in-school factors and to work locally to reinforce and expand 
their effects, regardless of the external factors present. This is not a simple task: Schools 
are complex and human institutions, rooted to their local communities and to the larger 
professional education community in intricate ways. But any school- whatever its 
circumstances or its community’s circumstances-can improve. 

These requirements demanded an evaluation that recognized the differences among 
individual schools and districts and used local school data, nested within larger 
perspectives on student academic performance and school improvement patterns. 

NCREL collected data at three levels: 

♦ Using statistics from the Kansas State Board of Education, the National 
Center of Education Statistics, and the U.S. Census, we built a database of 
statistical data describing Kansas’ public schools and districts. 

♦ For each of the 135 pilot schools, we collected documents descriptive of the 
schools and their QPA participation as well as survey data from principals and 
teachers. 

♦ In site visits to 20 Kansas schools, we conducted observations and collected 
focus group and interview data. 

The statewide data permitted broad-stroke statistical analyses of student academic 
performance. The documentary and survey evidence from the 135 schools sharpened the 
focus of the statewide analysis, generating glimpses of the form and functioning of the 
factors that affect school change. The site-based evidence permitted direct testing of the 
foregoing analyses and, most important, described the dynamics of in-school processes. 

Our plan of work was as follows: 

♦ For all Kansas schools, analyze Kansas Assessment and QPA indicator data 
for trends over time in student academic performance and identify any 
relationships of those trends to each other and to other demographic and 
educational variables. This portion of the analysis sought to determine if 
change in student academic performance over time was evident in the QPA 
pilot schools from a large-scale perspective. 

♦ For the 135 QPA pilot schools, obtain, from survey results and document 
analysis, measures of change in teacher and principal behavior and analyze 
these in relationship to changes in student academic performance. This 
portion of the analysis attempted to define some of the key factors 
contributing to change, using a middle-level perspective. 

♦ For 20 schools with records of improving student academic performance over 
time, observe closely, via interviews and on-site observation, how these 
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